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Abstract 

Wc consider several multiscalc- in-time kinetic Monte Carlo models, 
in which some variables evolve on a fast time scale, while the others 
evolve on a slow time scale. In the first two models we consider, a 
particle evolves in a one-dimensional potential energy landscape which 
has some small and some large barriers, the latter dividing the state 
space into mctastable regions. In the limit of infinitely large barriers, 
we identify the effective dynamics between these macro-states, and 
prove the convergence of the process towards a kinetic Monte Carlo 
model. We next consider a third model, which consists of a system of 
two particles. The state of each particle evolves on a fast time-scale 
while conserving their respective energy. In addition, the particles 
can exchange energy on a slow time scale. Considering the energy 
of the first particle, we identify its effective dynamics in the limit of 
asymptotically small ratio between the characteristic times of the fast 
and the slow dynamics. For all models, our results are illustrated by 
representative numerical simulations. 
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1 Introduction 



Langevin dynamics is commonly used in computational statistical physics to 
model the evolution of atomistic systems at finite temperature. The state of 
the system evolves according to a stochastic differential equation, and is thus 
modelled as a real vector valued Markov process. Generically, the state space 
of such atomistic systems can be decomposed into several metastable regions, 
separated by high energy barriers. It is therefore natural to introduce kinetic 
Monte-Carlo models as a simplification of the continuous-in-space reference 
model, where the state space is coarse-grained into discrete states that each 
corresponds to a metastable region of the continuous model. We refer e.g. 
to [11] for a formalization of this idea. The resulting dynamics is a time 
continuous Markov chain, also called jump process. 

In this work, we consider such a jump process, with the particularity 
that two different time scales are present in the system. On a typical tra- 
jectory, many jumps of the fast degrees of freedom occur before a significant 
evolution of the slowly varying variables is observed. Therefore, a direct 
discretization is numerically very costly (this problem is known as the small 
barrier problem). The aim of this work is to find an effective dynamics 
for the slow variables (which turns out to be again a kinetic Monte Carlo 
model) while filtering out the fast variables. This effective dynamics is de- 
rived in the regime of large time scale separation between the slow and the 
fast variables. 

We will successively perform this derivation for three different models. 

First, in Section [21 we consider a particle subjected to a potential energy 
presenting two macro-states separated by a high energy barrier. Inside each 
macro-state, there are finitely many micro-states separated by relatively low 
energy barriers (see Fig. [I]). The ratio between the low energy barriers and 
the large energy barriers is characterized by a parameter e that we will 
take asymptotically small. This ratio encodes the difference of time scales 
between the dynamics within a macro-state (only low energy barriers have 
to be overcome, and the dynamics is therefore fast), and the global dynamics 
(for which large energy barriers have to be overcome, making this dynamics 
slow). See Section I2TT1 for a complete description of the model. 

We are interested in the long time behavior of functions of the slow 
variables. We consider in this article the simplest case of such function, that 
is, the macro-state in which the particle is located. At the price of additional 
technicalities, our approach carries over to more general functions of the slow 
variables. 
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Under an irreducibility assumption on the dynamics within the macro- 
states, we prove that, in the limit of asymptotically large time scale sep- 
aration (namely when e goes to zero), the dynamics of the slow variable 
converges to a jump process over the two macro-states. The transition rates 
of this limiting process are, in some sense, the weighted averages of the tran- 
sition rates of the reference model. We underline that our convergence is 
a convergence on the path of the system, and not only on the state of the 
system at any given time. Our main result, Theorem 12.31 is presented in 
Section 12.11 and proved in Section 12.21 

In Section 12.31 we present detailed numerical results illustrating our the- 
oretical conclusions. In particular, we monitor the probability distribution 
of the first waiting time in a macro-state, and check that this distribution 
indeed converges to the asymptotic distribution. 

In Section [3l we turn to our second model, which is a generalization 
of the model considered in Section [2] where the potential energy presents 
infinitely many macro-states instead of two. To simplify the problem, we 
assume that the internal dynamics within each macro-state are identical 
(see Section [3.11 for a detailed presentation of the model). In this case, the 
effective dynamics is a time continuous random walk with Poissonian waiting 
times, as stated in our main result of that Section, Theorem l3.11 We provide 
some representative numerical results in Section [3.21 

We finally turn in Section [4] to our third model, which is different in 
spirit from the models studied in Sections [2] and [3l One interest of this 
last section is to show that the arguments employed to analyze the first 
two models can be used to study a model different in nature. The system 
at hand in Section U] contains two particles, each one being described by k 
spin- like variables. The system evolves either due to the internal evolution 
of each particle (which occurs on a fast time-scale) , or due to the interaction 
between the two particles (which occurs on a slow time-scale). In the first 
case, the energy of each particle is preserved while in the second, there is an 
exchange of energy between the two particles. Note that the total energy of 
the system is preserved in both cases. Our quantity of interest is the energy 
of the first particle, which is indeed a slow observable (see Section 14.11 for a 
complete description of the model). We show that the dynamics of the first 
particle energy converges to a jump process on the (finite) set of admissible 
energies, this set being determined by the initial energy (see Section 14.21 
Theorem 14. 1[ for our main result). We collect in Section [4.31 some numerical 
illustrations. 
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The difficulty of the question we address stems from the fact that the slow 
observable is not a Markov process: this is a closure problem. A typical tool 
in this context is the Mori-Zwanzig projection formalism, which is described 
in details in [6] . This leads to approximating the slow observable by a process 
which has some memory in time. In our work, we assume that a time-scale 
separation is present in the system. Memory effects may then be neglected, 
and the slow observables be approximated by a Markov process. As often 
the case in such settings, an essential ingredient of our proof is an averaging 
principle (see [15] for a comprehensive review of that principle in various 
contexts) . We refer to [T4"l [T7\ [T8] for related works in the framework of 
discrete time Markov chains in a discrete state space. 

As pointed out above, kinetic Monte Carlo models are somewhat ob- 
tained as a coarse-grained approximation of real valued Markov processes, 
such as the Langevin equation (or its overdamped limit). In that framework, 
the construction and the analysis of effective dynamics has been undertaken 
in several works, see e.g. \12\ [T3] and the comprehensive bibliography con- 
tained therein. 

Throughout this paper, we use several well-known results that we recall 
in Appendix IA1 below. 

2 A particle in a potential energy landscape with 
two macro-states 

In this section we study the dynamics of a particle in a potential energy with 
two macro-states (see Fig. Q]). The state of the particle is represented by 
a macroscopic variable (the index of the macro-state), which can take here 
only two values, and a microscopic variable (the index of the micro-state 
within the macro-state). We are concerned with the long time behaviour of 
the macroscopic variable. In Section \2. 11 we present the model and state our 
convergence result (Theorem I2.3P , the proof of which is given in Section 12.21 
Numerical results illustrating our theoretical conclusions are gathered in 
Section 12.31 

2.1 Presentation of the model and main result 

We now formalize the model described above. We introduce a parameter 
e which represents the ratio between the characteristic time of the internal 
dynamic inside a given macro-state (fast time scale) and the characteristic 
time of evolution of the macro-state, namely the characteristic time the 
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Figure 1: Example of a potential energy with two macro-states of energy 
wells. 



system spends in a given macro-state before going to the other one. For 
simplicity, we assume that both macro-states contain the same number of 
micro-states. The macro-states are labelled by and 1, whereas the micro- 
states are labelled as 1, 2, . . . , m. We set M = {1, 2, . . . , m}. 

The state of the particle is modelled by a time continuous Markov chain 
Y t e = (X t e ,Z|), which takes its values in the space E = M x {0,1}. The 
first coordinate of Y t e represents the micro-state of the particle inside a 
given macro-state, and thus takes its value in M. The second coordinate 
determines in which macro-state the particle is located at time t: Z\ = or 
1. 

We denote by Q the transition matrix of the process Y t e . Let Qo and 
Qi be two mxm matrices that determine the internal dynamic within each 
macro-state and let Cfa i and Ci o be two mxm matrices that determine the 
coupling between micro-states that belong to different macro-states. The 
transition rates of are given by 

Q e ((x, z) , (V, z)) = Q z (x,x'), z = or 1, x x' , 
Q e ((x, z) , (x, z')) = eC Z) i- z (x, x') for z ^ z . 

Thus, Q e is of the form 



Remark 2.1. As always for Markov jump processes, the diagonal entries of 
the transition matrix are irrelevant. Our convention is to take them equal 
to zero. 

The process Y t e is a jump process. It means that, when it is in a state 
(x, z), then 




Qo eCo, 
eCi,o Qi 
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it stays there for a time S, which is a random variable distributed 
according to an exponential distribution of parameter 



q € (x,z):= ^2 Q 6 {( x ,z) ,(x',z')) , 

that is P (5 < t) = 1 - exp (-q* (x, z) t). 

• At this time S, it jumps to another state. The probability that it 
jumps to the state (x', z') ^ (x, z) is given by 

Q € ((x,z),(x',z')) 
q e (x, z) 

Note that the paths of a jump process are by convention right continuous, 
with left limits (they are thus cad-lag functions). 

We are interested in the behaviour of a macroscopic observable, that is 
a function of the slow variable Z t . The dynamic inside a given macro-state, 
i.e. when the variable z does not change, has a characteristic time of the 
order of O (1) (i.e. independent of e), whereas the characteristic time for the 
particle to go from one macro-state to the other is of the order of O (e _1 ) • 

We therefore consider henceforth the rescaled-in-time process (-^t/e) • We 

introduce the process Y t e := Y t i e , which is a jump process of intensity matrix 
Q e given by 

* - ( e 7: X ) ■ « 

We assume that 

the matrices Q$ and Q± are irreducible, (2) 

therefore admitting unique invariant measures denoted by ttq and 7ri, re- 
spectively. 

Remark 2.2. Due to our convention on the transition matrix (see Re- 
mark \KT\) . the invariant measure ir of a transition matrix Q = j< m 
satisfies ir T Q = tt t A, where A is a diagonal matrix with Aj = X^jli 
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Definitions and notations We denote by Dr [0, oo) the set of cad-lag 
functions denned on [0, oo) and valued in R, and by Cr [0, oo) the set of 
continuous functions defined on [0, oo) and valued in R. Endowed with the 
Skorohod metric (see e.g. [H p. 116-118]), .Dr [0, oo) is a complete separable 
space. 

A family of probability measures V n on Dr [0, oo) is said to weakly con- 
verge to a probability measure V on Dr [0, oo) if, for any bounded continuous 
function $ on Dr [0, oo), 

lim $dv n = / $ dv. 



> 5C 
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A family of random variables X n valued in Dr [0, oo) is said to converge 
in distribution to X G Dr [0, oo) if the distribution of X n weakly converges 
to the distribution of X. Otherwise stated, the family X n converges in 
distribution to X if, for any bounded continuous function <1> on Dr [0, oo), 
we have 

lim E [<$>{X n )\ = E [$(*)] . 

n— yoo 

Throughout this article, we use the symbol => for the convergence in dis- 
tribution of cad-lag stochastic processes or the weak convergence of their 
corresponding distributions. 



Main result We are now in position to present the main result of this 
section. For z € {0, 1}, we define 

C Zy i- z {x)= ^2 C Z:1 - z (x,x') 
x'eM 

and 

K = C Zt i- z (x) ir z (x) = tt z (x) C z ^i- Z (x, x') . (3) 

x£M x£M i'eM 

Theorem 2.3. LetY t e = (X£, ZD be the jump process of intensity matrix ([I]) 
and starting from an initial condition Yq = (Xq,Zq) independent of e. We 
make the assumption §2$ . We denote by V e the distribution of the process 
{ZD and by V the distribution of the jump process of initial condition Zq 
and of intensity matrix 

Co")' W 

where Aq and \\ are defined by ([3]). Then, we have V € => V as e goes to 0. 
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Note that, in we have used the convention detailed in Remark 12.11 

The above result confirms the intuition according to which, when e goes 
to zero, the internal dynamic within each macro-state is speeded up, thus 
attaining a local equilibrium where configurations are distributed according 
to the invariant measures ttq and tt\ within the macro-states. In the limit 
when e goes to 0, the transition from one macro state z to the other one, 1 — z, 
occurs with the frequency X z , which is a weighted average (over the micro- 
states x, with weights given by the invariant measure tt z ) of the frequencies 
C Zj i- z (x). In turn, these frequencies are the transition frequencies from the 
micro-state x of the macro-state z to the other macro-state. 

As already emphasized in the introduction, we point out that the above 
theorem states a convergence result on the path (Z^)t>o, and not only of the 
random variable Z\ at any time t. 

2.2 Proofs 

To simplify the notation, we first consider the case when both macro-states 
are similar: in that case, Qo = Qi = Q and Co,i = Ci$ = C. The proof 
of Theorem 12.31 is performed in Section I2.2.2| and uses some intermediate 
results shown in Section 12.2.11 We briefly mention in Section 12.2.31 how to 
adapt the proof to handle the general case. 

The following computation will be very useful in what follows. Recall 
that the generator of the process Y t e is given by 

L e ip (x, z) = ^2 e_1( 5 ( x > x ') {f z ) ~ V ( x , z )) 

x'EM 

+ ^2 C (x, x') {if (x', 1 - z) - if (x, z)) . 

x'GM 

We refer the reader to the textbook [H Section 4.2] for more details on 
semi-groups and generators associated to jump processes. 

Taking (p(x,z) = l z= i(x,z) in the above relation, we obtain 

L e l 2 =i (i,z) = -^C (x, x') l 2= i(x, z) + ^2 C (x, x) l 2= oO, z), 
x'eM x'eAf 

and thus, taking (x, z) = Y t £ = (Xf, Z\\ we have 

m z=1 (Y*)= ^ C{Xl,x'){l-2Zt) = C{Xt){l-2Zf) 
x'eM 
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where C(x) = ^x'eA/^ (x,x r ). We now define the process (Mf) t >o by 

Ml = W(l?)-WW)-f£ e U(l?)i« 

J o 

Using Proposition IA.11 we see that M t e is a martingale with respect to the 
filtration Tl = a (Y/, s < i), and that its quadratic variation is given by 

(M € ) t = f (L € l z= i (Y/) - 2 l z=1 (Yg) m z=1 (Yg)) ds 
Jo 

= fc(Xl){l-2Zl)-2ZlC(Xl) {l-2Zt)ds 
Jo 

= ( C{Xl){l-2Zl) 2 ds 
Jo 

= [ C{Xl)ds 
Jo 

= [ g(Xt)ds + Xt, (6) 
Jo 

where A = Ao = Ai (see ([3])) and 

g (x) = C(x)-X= C(x,x')-X. (7) 

We have used in the above computation the fact that (1 — 2ZI) 2 = 1, a 
direct consequence of the fact that Z\ = or 1. 
In what follows, we will use the fact that 



Z\ = Z + f f (Y/) ds + [ A (1 - 2ZD ds + Ml 
Jo Jo 



(8) 



with 

f(x,z): 



(j2 C{x,x')-x) (l-2z) 
\x'eM J 



which is a straightforward reformulation of ([5]). 



9 



2.2.1 Some intermediate results 

The following results are useful in the proof of Theorem 12.31 

Lemma 2.4. Let L be a m x m matrix and let x £ M. m . Assume that for 
any y € R m such that y T L = 0, we have y T x = 0. Then, there exists z € M m 
such that Lz = x. 

Proof. We denote by C\, . . . , C m the columns of the matrix L and by 
V = SpanjCi, . . . , C m }. The assumption on x is that x 6 (V ) = V. 
Therefore, x can be written in the form x = Y^=\ a iCi for some coefficients 
(«i)i<i<m- Let z = YT=i a i e ii witn ( e i)i<i<m tne canonical basis of R m . 
We check that z satisfies Lz = x. □ 

Lemma 2.5. Let F = {0, 1}, Zq be a random variable valued in F, Ao, Ai > 
0, and (Zt) t>0 be a stochastic process on F. If the process 



is a martingale with respect to the natural filtration of (Z t ) t>0 , then (Z t )t>o 
is a Markov jump process of initial condition Zq and of intensity matrix 
given by 



Proof. We use the uniqueness result of the martingale problem associated 
to the Markov jump process with intensity matrix R introduced by DW. 
Stroock and S.R.S. Varadhan (see e.g. [8J Theorem 21.11]). We recall a 
simple version of that result in Lemma [A . 2 1 b elow . In view of that result, we 
only need to check that, for any bounded function (p : F i— > R, the process 



is a martingale, where L is the generator of the jump process associated to 
the intensity matrix (|10p . which reads 





(10) 




z'&F 



We note that 



L^{z = 0) = Ao Ml) - <p(0)) , Lip(z = 1) = Ai (v?(0) - ^(1)) . 
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Since F = {0, 1}, any bounded function 99 : F 1— > R is of the form 



Vz € F, (p(z) = a5 0z + bSi z = a + (b — a) 5i z , 

for some a and b, where 5\ z is the Kronecker symbol. The application ip 1— > 
Mf is obviously linear, and it vanishes for constant functions. Therefore, 
to show that Mf is a martingale for any bounded function ip : F 1— > M, it is 
sufficient to show that M^ 12 is a martingale. On F, we see that 5\ z = Id. 
We thus have 



r-t 

I Lld(Z s )ds 




Z t -Z Q - / (A - (A + Ai) Z s ) ds. 
Jo 



Using the assumption of the Lemma, we have that M^ lz is a martingale. 
This concludes the proof. □ 

Lemma 2.6. Let g : R — > R 5e a Lipschitz function. Then, the function <J> 
defined by 

$ : Dr [0, 00) -> C R [0, 00) C D R [0, 00) 
x h-> g (x (s)) ds 

is continuous. 

Proof. Let (x n ) ne pj be a sequence in Dr [0, 00) and x in Dr [0, 00) such that 
(%n)n&N converges to x in [0, 00) for the Skorohod topology. We show 
that ($(x n )) ng N converges to <£(x) in the Skorohod topology. 

We first observe that, for any y £ Z?r [0, 00), the function 5>(y) is con- 
tinuous. Since the limit function is hence continuous, the convergence 
of (<3?(x n )) ng N to <3?(x) in the Skorohod topology is equivalent to the con- 
vergence of ($(x n )) ne N to $(x) according to the norm || • ||c°([o,T])> on an Y 
compact time interval [0,T] (see e.g. [3 p. 124]). 

We now proceed and show that, for any T > 0, ||$(x n ) — <lKx)||c ([o,T]) 
goes to zero as n goes to 00. Using the characterization of the convergence of 
(x n )neN to x given in Proposition IA.3[ we know that there exists a sequence 
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of strictly increasing, continuous maps A n denned on [0, oo) satisfying (05 
and P6|) below. We then have, for any t € [0, T], 

\$ (x n ) (t) - $ (x) (t)\ 

(9 (x n (s)) - g{x(s)))ds 



< 



g (x n (*)) -g(x (A n (s)))| ds +/ \g (x (A„ (*))) - <? (x (s))| ds(ll) 



The first term of the right-hand side of (|lip tends to as n goes to co 
uniformly on [0, T\. Indeed, 



\g(x n (s)) - g{x(\ n (s)))\ds < T sup \g (x n (s)) - g (x (A n (s) 

se[o,T] 

< TC S sup |x„ (s) - x (A n (s))\ , 

s6[0,T] 



sup 

tG[0,T] ^0 



where C g is the Lipschitz constant of g. Using (|46l) . we deduce that 



= 0. 



lim sup / \g(x n (s)) - g(x(\ n (s)))\ 
n ^°°te[o,r]io 



(12) 



We now turn to the second term of the right-hand side of (llip . Take a > 0. 
Using [2l Lemma 1 p. 110], we know that there exists a subdivision 

= t < ti < ■ ■ ■ < t r = T 

of [0, T] such that, for any i, 

sup{|x (s) — x (i) |, U < s < t < U + i} < a. 

This result is based on the fact that (i) a continuous function on a compact 
set is also uniformly continuous on this set, and (ii) for any (3 > 0, a cad- 
lag function on a compact set has a finite number of jumps larger than the 
threshold j3. 

Using this subdivision of [0, T], we bound the second term of the right- 
hand side of (fTT|) by 



/ \g(x(X n (s)))-g(x(s))\ds < V) / ' kj (x (A n ( S ))) - 5 (x (s))| 

J0 , n Jti 



ds 



i=0 
r-l 

< 

i=0 



|x(A n (s)) -x(s)|ds.(13) 
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Let us introduce 5 > such that for any < % < r— 1, we have 25 < ij. 
As there is a finite number of points tj, such a 5 > exists. Using the 
property ([4"5|) of A n , we know that there exists N such that, for any n > N, 

we have sup |A n (s) — sj < 5. We therefore deduce that, for any n > N, 

se[o,T] 



2 , / \ x (K (s)) - x (s) \ds 

i=0 "'*» 

r-1 rU+i-8 

te\o,T+S] 



i=0 Jti+6 te[0,T+S] 
r-1 

< V] (t i+ i - - 25) a + 4r<5 sup \x (t) \ 

i=0 *G[0,T+<5] 

< Ta + 4r5 sup (14) 

te[o,T+5] 

Inserting (fT4"P in (fl~3]) , we deduce that the second term of the right-hand side 
of (fTT]) is bounded by 



L 



t 

\g (x (A n (a))) - 5 (x (a)) I < <? 3 Ta + 4C 9 r<5 sup |x (t) 

te[Q,T+8] 



As a and 5 are arbitrary small, and r only depends on a, we conclude that 
the second term of the right-hand side of (jlip converges to uniformly in t 
on [0,T]. 

Collecting this result with the limit (|12p on the first term and (jlip . we 
deduce that 

lim sup |$ (x n ) (f) - $ (x) (i)| = 0. 

This concludes the proof of Lemma 12.61 □ 

Remark 2.7. If the function g is not continuous, then 3> is not continuous. 
Consider indeed a sequence (x n ) n ^fq of real numbers that converges from 
above to x, a discontinuity point of g. Denoting (x n ) the image by <3? of 
the constant function equal to x n , we see that, for any t, 

$ (x n ) (t) - $ (x) (t) — ► t(g(x+)-g(x))^0. 

We conclude these intermediate results with the following proposition, 
that will be useful to study the limit when e — > of the second term in the 
right-hand side of (jHJ). 



13 



Proposition 2.8. Let f be given by ([9]). Under the hypothesis of Theo- 
rem \2.3[ we have, for any t > 0, 



E 



t \ 2' 

f{Ys)ds 



o 



as e -> 0. (15) 



Proof. Since S is a finite set, we identify functions (p : E — > M. with the vec- 
tors (( ( p(x,0)) xeM , (ip(x, 1)) x€ m) e throughout the proof. We likewise 
identify operators with matrices. 

Let L be the generator corresponding to the intensity matrix Q : 



L u (x, z) = ^2 Q ( x ) x ') { u z ) ~ u ( x ) z )) 



—o 

u{x,z) = 

x'&M 

First, we claim that 



there exists a function u : E i— > M such that L°u = /. (16) 

Indeed, as Q is irreducible, the only vectors n € M 2m such that /i T L° = 
are the vectors of the form /j, a ^ = (an, f3ir) for any a, j3 € E (this is a 
simple consequence of the Perron- Frobenius theorem). Using © and (|3|), 
we compute 

A»/ = ^«^(x)/(x,0)+ ^/3vr(x)/(x,l) 

I6JU xGM 



(«-/?)( J>(x) ^ C(x,x')-A] 



(17) 



We thus see that, for any \i E M 2m such that /j? L° = 0, we have /i T / = 0. We 
are now in position to use Lemma [2.4l from which we deduce the claim (|16p . 

Second, using (pT6|) . we write that 



f f{Y*)ds = f T?u(Y*)ds 
Jo Jo 

= e[ L e u(Y*)-e [ L c u(Y s e )ds (18) 
Jo Jo 



where we have used the decomposition 



eL e u = L°u + eL c u 
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with 



L c u (x, z) = C ( x > x ') { u { x ' ' 1 1 — z) — u(x, z)) 



x'eM 



We successively bound the two terms of the right-hand side of (|18p . Intro- 
duce iV t M = u(Y t e )-u (F e ) - / L e u (Y s e ) ds. In view of Proposition EH we 

Jo 

know that iV" is a martingale of quadratic variation given by 

(N u ) t = f [L e u 2 (F/) - 2u (F/) Vu (F/)) ds. 
J o 

For any u : E — >• R, we have 

IlL^Hoo < 2m||«||oo (e _1 ||<5||oo + ||C||t») • 



Therefore 

2 



E 



= K((N u ) t ) 

< 2mt[\\u 2 \\ a 

< A + e~ 1 5, 



„-i 



+ ||C|| 00 )+2|H|^(e- 1 ||Q|| 00 + ||C| 



where A and -B are positive constants independent of e. It follows that the 
first term of the right hand side of (I18p satisfies 



E 



t 

e I Vu{Y s 
o 



E 



{e{N?-u{Y{) + u{YZ))f 



< 2e E 



< 2e 2 (A' + e^B) . (19) 
For the second term of the right hand side of f)18[) . we directly obtain 



E 



<e 2 t 2 (4m||C||Ll|«||L)- 



(20) 



Collecting (flg|). (fT9|) and P0|1. we obtain the desired result ([15]). This con- 
cludes the proof of Proposition 12.81 □ 
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2.2.2 Proof of Theorem 12.31 (symmetric case) 



All the convergences in this proof are taken when e goes to 0. We will omit 
to recall it. The proof consists of four steps. 

Step 1: the family of probability measures {V e ) e>0 is relatively 
compact 

We use the tightness criterion of Theorem \AA\ and check that its con- 
ditions (j4"T|) and (HU) are satisfied. 

As the variables Z\ take only two values, and 1, the condition (|47p is 
trivially satisfied with the choices K = 1 and uq = 1. 

Let us now show that the condition (|48p is satisfied. Let N E N, a > 0, 
9 > and e > 0. Let S and T be two ^-stopping times such that S <T < 
S + 9 < N. Recall that a random variable T : (tl, (Tt) t> oj -> M + U{oo} is a 

stopping time if, for any t > 0, the set {T < t} is .^-measurable. Using ©, 
we have 



I Z^ — Z g | ^ 



f Y J C{Xl ) y){l-2Zt)ds 



+ |Mf-M£|. (21) 



The first term of the right-hand side of (12111 is bounded as follows: 



F ^TC(XI,y)(l-2ZI)ds 

Js yeM 



< \T - S\m\\C\\ OQ < 0m\\C\ 



(22) 



To bound the second term of the right-hand side of f)21 1) , we use the Tchebytchev 
inequality: 



|Mf - M|| > a) < - 1 



a- 



(23) 



We denote by Mf = M t e +g - M| and J"| = J" t e +S . As 5 is a bounded 
stopping time, we infer from the optional stopping theorem (see e.g. [TBI 
Theorem 3.2]) that M e is a ^-martingale, of quadratic variation 



In particular, we have 



(M e ) T _ 5 = (M 6 )t - (M e ) s . 
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It follows that 

E [|Mf 



M 



e 1 21 



E 
E 



T-S\ 



{M e ) T -s 



E[(M e ) T 
E ' 



where we have used 
that 



We deduce from ([2T 
below is satisfied. 



g(Xt)ds + X(T-S) 

Js 

+ A) , (24) 
and where g is defined by ([7J . We then infer from 
"'slloo + A) 



< 



M 



M|| >a)< 



cr 



(25) 



22D and ([25]) that the condition (08]) of Theorem [O] 



Assumptions (f4"Tj) and ([411 being satisfied, we can apply Theorem IA.41 
which implies that the family of probability measures (V e ) t is tight. In 
view of Prohorov's theorem (see e.g. [H Theorem 2.2]), this implies that the 
family (7 7<E ) e> o is relatively compact. 

There thus exists a sub-family of (V e ) e , that we denote [V e ' ) , which is 



convergent. Otherwise stated, there exists a process Z such that Z e Z. 

Step 2: there exists a martingale M t and a sub-family M t e such 
that Mf M t 

In view of [7] Theorem VI. 4. 13], a sufficient criterion for (M e ) to be 
relatively compact is that {{M e )) is C-tight. Let us check this criterion. We 
have shown above (see ([6])) that 



f g{Xl)ds + \t, 
Jo 



where g is defined by ([7]). Therefore, the family of paths ((M e )) e>0 is uni- 
formly Lipschitz, and hence C-tight (see [7] Definition VI. 3. 25 and Propo- 
sition VI. 3. 26]). We can thus consider a sub-family of (Mt) t>Q , that we 

denote ^Mj ^ , which weakly converges to a process M. Using [TJ Propo- 
sition IX. 1.1], we know that the process (Mt)t>o is a martingale with respect 
to its natural filtration. 



Step 3: equation satisfied by Z 
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We have shown at the end of Step 1 that there exists a process Z and a 
sub-family Z e such that Z e => Z. We now identify a stochastic differential 
equation satisfied by {Z t )t>o- 

Recall first that (Z^)t>o satisfies (|8|), namely 



Z\ = Z + f f (Y<) ds + /* A (1 - 2ZI) ds + Ml 
Jo Jo 

Passing to the limit e' — > 0, let us show that (Zt)t>o satisfies 

Z t = Z + I A (1 - 2Z S ) ds + M t . 
Jo 



(26) 



(27) 



We first consider B\ = / / (Y" s e ) (is. With the same techniques as above, 

Jo 

we can show that {Bf) is a relatively compact family. There thus exists (Bt) 
and a sub-family f-^f'l such that B e ' 5. We infer from Proposition 12.8 
that, for all t > 0, JB| converges to in L 2 (ft), hence E [JBf] = for all 
t > 0. It follows that the family ( B| ) converges to in distribution. 



We next turn to J e t = [ A (1 - 2Z e s ) ds. Introduce J t = [ A (1 — 2Z S ) ds 
Jo Jo 
The function g : z H > A (1 — 2z) is Lipschitz on R, thus, using Lemma 12.61 

we know that the function 

$ :j D r [0,oo) — > L> H [0,c3o) 



z ^ / A(l-2z(s))ds 



o 



is continuous. The convergence Z e Z therefore implies that 

J e ' = $(Z e ') $(Z) = J. 



We have thus obtained that all the terms in (J26J) weakly converge. It remains 
to show that we can add up the weak limits. To do so, we show with the 
same techniques as before that the family (B e , J e ,M e ) is relatively compact, 
and that the limit of any sub-family has as marginal distributions those of 
B, J and M. We conclude that B e ' + J e ' + M e ' => B + J + M . Passing to 
the limit e 1 — s> in ()26|) . we then indeed obtain ([2j 

Step 4: conclusion 
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We infer from (|27p (where, we recall, M± is a martingale) and Lemma [23] 
(with Ao = Ai = A) that (Zt) t>0 is a Markov jump process of initial condition 
Zq and of intensity matrix given 



It follows that all convergent sub- families Z e have the same limit Z . 
The whole sequence Z e therefore converges to this common limit Z. This 
concludes the proof of Theorem 12.31 in the symmetric case. 

2.2.3 Non-symmetric case 

In this Section, we briefly sketch the proof in the non-symmetric case, that 
is when Qq ^ Q\ or Cb,i ^ C^o in (HJ. The structure of the proof is similar 
to that in the symmetric case. 

First, the generator associated to the process (Y t e ) reads 




The process Z is thus uniquely defined. 



L e tp(x,z) = ^ e 1 Q z (x,x') (ip(x',z) - ip(x,z)) 



x'eM 



+ ^ C z,^-z ( x ' x ') i x '' 1 - z ) - V ( x > z )) ■ 



x'eM 



Choosing the function (p (x, z) = z, we see that 



L'tp (x, z)=J2 C z,i-z (x, x 1 ) (1 - 2z) = f(x, z) + h(z) 



x'GM 



where we have introduced (recall (|3|)) 




and 



h{z) = (l-2z)\ z = (l-2z) J2 C gtl - Z (x,xf)ir x (x). 



x,x'SM 



Using again Proposition IA.H we see that the process 



Mf 




(28) 
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is a martingale. Using the above notation, the equation ([28]) can be recast 



as 

r-t 



ZI = Z +f f(Y*)ds+ [ h{Zl)ds + Ml (29) 
Jo Jo 

To pass to the limit e — > in the above equation, we follow the same lines 
as in the proof detailed in Sections 12.2.11 and 12.2.21 



Consider the second term of the right-hand side of (|29[) . As in the proof 
of Proposition 12. 8| we can show that fi T f = for any \i 6 R 2m such that 
fi T L = 0, which are vectors of the form (aiTQ, f3ir\) for any a and f3 in R. 

This implies that / / (Y*) ds converges to in I? (fi) for any t > 0. 
Jo 



We turn now to the third term of the right-hand side of (J29J). Let h 
be the affine function defined on R by h(0) = h(0) and h(l) = h(l). The 
function h is obviously Lipschitz on R, hence, using Lemma \2.6\ we know 
that the function 

$ :j D k [0,oo) -)■ Ai[0,oo) 

2 h-> h(z(s))ds 

is continuous. Since / /i (Z|) ds = h (Z e s ) ds, this allows to pass to the 
io io 

limit in that term. 

As in Section [2.2.21 (Step 3 of the proof), we can thus pass to the limit 
e — > in ([29]) . and show that Z e converges in distribution to a process Z, 
that satisfies 



Z + [ h(Z s )ds + M t 
Jo 

Z + [ [\ -Z s (\ + \ 1 )]ds + M t 
Jo 



where M is a martingale. We then infer from Lemma 12.51 that (Zt) t>0 is a 
jump process on {0, 1}, of initial condition Zq and of intensity matrix 

A 
Ai 

as claimed in Theorem 
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2.3 Numerical illustration 



We have implemented the model presented in Section 12.11 As shown on 
Fig. [TJ the energy wells can be gathered in two macro-states (each of them 
containing m micro-states) separated by a high potential energy barrier. The 
transitions are only possible from one well to its two nearest neighbours. In 
addition, we apply periodic boundary conditions. The matrices Qo, Qi, Co,i 
and Ci.o of the intensity matrix ([1]) read 



Qo = Qi = Q and C Q i = C 10 = C 



with 



Q 



( o 



V 



q 
o / 



c 



/o ••• 
••• 

\ c 



c \ 


o J 



We work with q = c = 1. 

We are interested in the distribution of the first exit time Sq from a 
macro-state. From Theorem 12.31 we know that, in the limit e going to 0, Sq 
follows an exponential distribution of parameter A = 2c/m (independently 
of what the initial condition of the system is) . In order to quantify the con- 
vergence of the distribution of Sq to the predicted distribution, we consider 
the L 1 norm of the difference of the densities: 



POD 1 71 

err Ll = / |/ - f\ « - J] |/ (iAx) - ft\, 
J ° n i=l 



(30) 



where f (x) = Xe Xx is the limit distribution and f e is the distribution of 
Sq. This latter distribution is calculated on the bounded interval [0, s] with 

s = nAx on a grid of size Ax: ff ~ — — f e { x ) f° r an y i £ [1> n \- 

xG[«Ax,(i+l)Ax] 

In the sequel, we work with Ax = 0.05 and s = nAx = 5. 

Remark 2.9. Other criteria can also be considered to characterize the con- 
vergence of the probability distribution f e towards f. One example is the 
discrepancy, which is the difference (in L°° norm) of the cumulative distri- 
bution functions: 



D 



sup 

A>0 



r 



10 JO 

We have used this criterion e.g. on Fig. [3| below. 



(31) 
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We first consider how results depend on e. We work with a fixed initial 
condition, namely Yq = (0,0). At the initial time, the particle is in the first 
macro-state, and in the micro-state which is the closest to the energy barrier 
between the two macro-states (see Fig. [[J. 

On Figs. [2] and EJ we show the convergence of the empirical expectation 
and variance of Sq to the asymptotic value (we have considered 10 4 indepen- 
dent and identically distributed realizations of the process to compute 95 % 
confidence intervals). We indeed observe convergence of both quantities to 
their asymptotic limits when e — > 0. 
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10 3 10 1 0.01 10'4 10 3 10 1 0.01 104 10 3 10 1 0.01 104 

cpsilon {m — 3) cpsilon (m — 5) cpsilon (m = 7) 



Figure 2: Empirical expectation of Sq as a function of e, for m = 3 (left), 
m = 5 (middle) and m = 7 (right). The asymptotic values (when e — > 0) 
are also represented (solid lines). 

On Fig. [H we show the histogram of Sq in the case m = 20 for two 
values of e. We again oberve a good qualitative agreement with the limit 
distribution for small enough e. This can be quantified by looking precisely 
at the convergence of the distribution of Sq to the asymptotic distribution 
when e goes to 0, for different values of m (see Fig. [5]). The left part of that 
figure seems to show that the convergence slows down when the number m 
of micro-states within a macro-state increases. 

We next monitor how the distribution of Sq behaves when we vary the 
initial condition. For this test, we work with m = 5. Figures [6] and [7] show 
the empirical expectation and variance for different initial positions and for 
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variance 
2.25 
6.25 
f2.25 



10° 10 1 0.01 104 10 10 1 0.01 104 10 10 1 0.01 104 

cpsilon (m — 3) cpsilon {m — 5) cpsilon (m = 7) 



Figure 3: Empirical variance of 5q as a function of e, for m = 3 (left), m = 5 
(middle) and m = 7 (right). The asymptotic values (when e — s> 0) are also 
represented (solid lines). 




Figure 4: Distribution of Sq, the first exit time from a macro-state (m = 20). 
Left: large e = 1. Right: small e = 10~ 3 . 

different values of e. We notice that, for an initial condition which is at 
the middle of the macro-state, the convergence with respect to e is slower 
than for the initial conditions which are at the boundaries of a macro-state. 
This difference is due to the diffusion phenomenon which occurs inside each 
macro-state as a result of the transition to the nearest neighbours. 
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Figure 5: L 1 error ([30]) (left) and discrepancy (f3Tj) (right) on the distribution 
of Sq as a function of e. 

To better understand the behavior of the system for large values of m, 
we have simulated our model with m = 20. We show on Figs. [5] and the 
empirical expectation and variance of Sq for two different initial conditions, 
one on the boundary (Yq = (0, 0)) and the other in the middle of the macro- 
state {Yq = (10, 1)). On Fig. [T0l we show the convergence of the distribution 
of Sq to its limit for these two initial conditions. 

We clearly see that the convergence is slower and the error margins are 
larger (for the same number of Monte-Carlo realizations) than when we chose 
smaller values of m (compare for example Fig. [8] with Fig. [2] or Fig. 1101 with 
Fig. [5]). The system indeed takes more time in a given macro-state before 
reaching its boundary and possibly jumping. 

To conclude this numerical illustration, we have monitored the distribu- 
tion of S\ , the exit time from the second macro state, and compared it with 
that of Sq, the exit time from the first macro-state. We observe (results not 
shown) that S"f has the same asymptotic behaviour as Sq, a fact which is in 
agreement with the theoretical predictions. 

Remark 2.10. The parameters of the numerical simulations reported here 
have been chosen so that the limit dynamics (at e = 0) is an inaccurate 
approximation of the reference dynamics when e is large (say e >1). 

There are actually cases when the limit dynamics is an accurate approx- 
imation of the reference dynamics, even if e is not small. For example, con- 
sider the case where, for a given macro-state (say Z = 0), the transitions 
from each micro-state of this macro-state to any micro-state of the other 
macro-state (Z = 1) share the same frequency. In the case of the symmetric 



24 




000001 1111 



01234012 
000001111 
initial condition 



3 4 1: 
0000011111 



Figure 6: Empirical expectation of Sq for different initial conditions and 
for e = 10 3 (left), e = 1 (center) and e = 10~ 3 (right). Initial conditions 

are shown on the x-axis in the format ( i° I € I , I , with M 

{0,1,2,3,4}. 



Z J \ {0, 1} 
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012340 1234 123401234 01234 1234 
0000011111 0000011111 0000011111 
initial condition 



Figure 7: Empirical variance of Sq for different initial conditions and differ- 
ent values of e, with the same convention as on Fig. [6] (results for e = 10 3 
do not fit in the chosen y-range). 




1000 100 10 1 0.1 0.01 0.001 

cpsilon (initial condition (0, 0)) 



1000 100 10 1 0.1 0.01 0.001 

cpsilon {initial condition (10, 1)) 



Figure 8: Empirical expectation of Sq for m = 20 and two different initial 
conditions: Y = (0,0) (left) and Y = (10, 1) (right). 
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1000 100 10 1 0.1 0.01 0.001 1000 100 10 1 0.1 0.01 0.001 

epsilon (initial condition (0,0)) epsilon (initial condition (10, 1)) 



Figure 9: Empirical variance of Sq for m = 20 and two different initial 
conditions: Y = (0,0) (left) and Y = (10,1) (right). 

model considered in Section \2.2\, the homogeneity condition means that 

C (x,x ,s ) = Cte independent of x. 

x'GM 

In this case, the macroscopic dynamic is decoupled from the microscopic 
variable, as can be seen from ([5]), and of course does not depend on e. 

3 A particle in a potential energy landscape with 
infinitely many macro-states 

In Section [2j we have studied the dynamics of a particle in a potential energy 
with two macro-states. We now turn to the system composed of a particle 
in a potential energy with infinitely many macro-states. We establish a con- 
vergence result on the dynamics of a slow quantity of interest in Section 13.11 
before turning to numerical illustrations in Section 13.21 

3.1 Presentation of the model and main result 

As mentioned above, we consider here the dynamics of a particle in a poten- 
tial energy with infinitely many macro-states. As in Section \2.1\ the state of 
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Figure 10: L 1 error (|30j) on the distribution of Sq for m = 20. Left: initial 
condition Yq = (0,0). Right: initial condition Yq = (10,1). 

the particle is described by Y t € = (X t e , Z t e ), which takes its values in M x Z, 
where again X| 6 M = {1, . . . ,m} is the label of the micro-state in which 
the particle is. The variable is the label of the macro-state in which the 
particle is at time t, and it now takes any value of Z. 

For simplicity, we assume that the dynamics within each macro-state 
is similar. We also restrict the transitions from one macro-state to its two 
neighbors. The transition from z to z + 1 may have different properties 
than the transition from z to z — 1 (thus creating a macroscopic drift in 
the dynamics). We also assume that the system is macroscopically homo- 
geneous, in the sense that properties are translation invariant with respect 
to z. Under these assumptions, a typical transition intensity for the process 

{ Y t) t is g iven b y 

yzeZ ± Q e ((x,z),(x',z)) 
VzGZ, Q e ((x,z),(x',z + l)) 
VzGZ, Q ((x,z),(x',z-1)) 

VzeZ, Q e {{x,z),{x',z')) 

We again assume that the matrix Q is irreducible (see ©) and introduce 
its unique invariant measure tt. The average of the jump frequency according 
to the invariant measure reads 

A; = Cl ( X ) x ') n ( X ) ) = C r (x, x') tt (x) . (33) 

x,x'GM x,x'<=M 

We introduce the generator L defined by: for any bounded function (p on Z, 

Lcp(z) = Xiip(z - 1) + XMz + 1) - (Ar + Aj) <f(z), (34) 



Q(x,x') , 
eQ (x,x') , 

if z' ^ z, z + 1 or z 



(32) 



1. 
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which is the generator of a jump process {Zt)t>o on Z, with jumps at times 
defined by a Poisson process of parameter A/ + A r . When the process jumps, 

it jumps to the right (resp. to the left) with probability - — — — (resp. 

K + A; 

-*-). 

A r + Az 

The main result of this section is the following: 

Theorem 3.1. Assume that the matrix Q is irreducible. Consider the 
rescaled-in-time process Y t e = {X^,Zf) = Y t u with initial condition Yq = 
(Xq,Zq) independent of e. We denote by V e the distribution of the pro- 
cess {Zf)* and by V the distribution of the process starting from the initial 
condition Zq and having as generator the operator L defined by (I34p . Then 

V e =^V as e goes to 0. 

The proof of this result follows the same steps as that of Theorem 12.31 
up to the fact that the process Z e is no longer bounded. To circumvent 
this difficulty, we need to work with an arbitrary bounded function of Z e , in 
contrast to the proof of Theorem 12.31 where it is sufficient to directly work 
with Z e . 

We briefly sketch the proof of Theorem 13.11 The generator L € of Y t e 
reads, for a bounded function ip, 

L e ip (x, z) = e l Q ( x i x ') {(f { x 't z ) ~ f { x i z )) 
x'eM 

+ ^2 Q (x, x') (if (x', z - l) - ip (x, z)) 
x'eM 

+ y) C r (x, x) {if (x 1 , z + l) - ip (x, z)) . 

For a function ip (x, z) = F(z) which only depends on the macroscopic vari- 
able (where F is a bounded function on Z), we have 

(L e F) (x, z)=Y J Ci {x, x') (F (z - 1) - F (z)) 
x'eM 

+ C r (x,x')(F(z + l)-F(z)). 
x'eM 

Using Proposition I A. 11 we know that the process 

Ml = F {ZD - F {Zq) - I {L e F) {XI, ZD ds (35) 

J o 
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is a Tl -martingale. We now introduce 

G(F) (x, z) = (F (z - 1) - F (z)) (Ci (a, x') - A/) 

x'eM 

+ (F (z + 1) - F (z)) {Cr {x, x') - \ r ) , (36) 

x'GM 

so that 

(L e F) (x, z) = G(F) (x, z) + LF{z) 
where L is defined by (JMJ). We then recast (|35p as 

F {ZD = F (Z ) + f G (F) (F s e ) ds + f LF {ZD ds + M|. (37) 



We are now left with passing to the limit e — » in ([31 

Consider first the second term of the right-hand side of (|3T|) . We have 
the following result (compare with Proposition I2.8P : 

Proposition 3.2. For any bounded function F defined on 7L and any t > 0, 

under the assumptions of Theorem 1 3. 11 we have 



E 



t 

G(F) (17) ds 



o 



as e — >• 0, 



where G(F) is defined by ([36]) . 

Proof. The proof follows the same steps as that of Proposition 12.81 Fix 
z € Z and consider the function x G M h-> G z {x) = G(F)(x, z), that we 
identify with a vector in M m , denoted G^. Using (|33|) . we observe that 
tt t G z = 0. We then deduce that, for any t/£R m such that y T (Q - A) = 
(where A has been defined in Remark 12. 2p . we have y T G z = 0. We then 
infer from Lemma [2. 41 that there exists u z € M m such that [Q — A) u z = G z . 
Introducing the function u(x, z) = u z (x), we easily check that L°u = G(F). 
The rest of the proof is identical to that of Proposition 12.81 □ 

For the other terms of (|37p . the proof follows exactly the same steps as 
in the proof of Theorem 12.31 We hence obtain that the weak limit Z of (Z e ) 
satisfies that, for every bounded function F on Z, there exists a martingale 
M F such that 

F (Z t ) = F (Z ) + f LF (Z s ) ds + Mf. (38) 
J o 

Using Lemma IA.21 we conclude that Z is a jump process of generator L 
defined by jS). 



30 



Remark 3.3. We refer to 110^ for the study of the limit process introduced 
in Theorem \ 3.1\ after a rescaling both in time and space. We show there 
that it converges to a Brownian motion (up to a multiplicative constant). 



3.2 Numerical illustration 

We have simulated the model described in Section 13.11 with the choices 



Q 



q 
o 



c. 



/o ... 



\ 



V 

ci \ 




o 7 



\ 



q q 
q / 



and C r 



( o 




\ 




\c r • • • / 

with q = 1, Cf = 2, q = 1, m = 5 and the initial condition Yq = (0,0) 
(similar results are obtained for other initial conditions). The parameters 
A r and A; of the macroscopic evolution are 



ci 



1 



A/ = — = - and A r = — = -. 

mo mo 

We first monitor the convergence of the distribution of Sq, the exit time 
from the first well. On Fig. [TT\ we show its empirical expectation and 
variance. We see that they converge to their asymptotic values as e goes 
to zero. This convergence is confirmed by the histogram representation (on 
Fig. [12]) . where we see a good agreement between the discrete curve and the 
asymptotic curve for sufficiently small values of e. Likewise, the L 1 error, 
also shown on Fig. [12] indeed converges to zero. 

We next study the distribution of the amplitude of the first jump of the 
macroscopic variable Z £ , that is the distribution of the random variable 



Za 



On Fig. [131 we show the empirical expectation and variance of AZ e , which 
are observed to converge to their asymptotic values. Note that the limiting 
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Figure 11: Empirical expectation (left) and variance (right) of Sq as a func- 
tion of e. 





Figure 12: Left and Center: Distribution of Sq, the first exit time from 
a macro-state (Left: large e = 1. Center: small e = 10~ 3 ). Right: L 1 
error ([30]) on the distribution of Sq, as a function of e. 



process Z, the generator of which is the operator drifts to the right, 

since A r > A;. We compute that 



E (AZ) = P (AZ = 1) x 1 + P (AZ = -1) x (-1) 



2/5 1/5 _ 1 
3/5 ~ 3/5 ~ 3' 



and we indeed see on Fig. Q3] that lim E (AZ € ) = E (AZ). On Fig. [TH we 
show the empirical distribution of AZ e for a small e, and we observe that 



'(AZ € = 1) « P(AZ = 1) 



'(AZ e 



-1) «P(AZ = -1) 



1 



We also check on Fig. O that the L 1 error between the distribution of AZ e 
and that of AZ goes to as e goes to zero. 
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variance h 



0.001 0.0001 105 1000 100 10 1 0.1 0.01 0.001 0.0001 



Figure 13: Empirical expectation (left) and variance (right) of AZ e as a 
function of e. 



Figure 14: Left: Empirical estimation of the probabilities P(AZ £ = —1) and 
¥(AZ e = 1) for e = 1CT 5 . Right: L 1 error (J3D) on the distribution of AZ e 
as a function of e. 

4 Exchange of energy in a system of two particles 

In this final section, we consider a more elaborate model. This model is 
composed of two particles. The state of the first (resp. second) particle 
is described by the vector X (resp. Z) with k components. An energy 
functional £ is associated to each particle. The system evolves either due to 
the internal evolution within a particle, or due to the interaction between 
the two particles. In the first case, the energy of each particle is preserved. 
In the second case, the internal energy of each particle varies, but the total 
energy of the system, £(X) + S(Z), is preserved. Interactions between the 
particles occur on a much slower time scale than the internal evolution of 
each particle. One must hence wait for a long time before observing any 
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change in each particle energy. 

The model is presented in details in Section 14, 11 In Section 14.21 we 
establish a convergence result on the time evolution of the energy of the 
first particle, which is our macroscopic variable of interest. We only give 
there a sketch of the proof as it follows the same arguments as before. 

One of the interesting features of this model is that the macroscopic 
variable of interest is not one cartesian coordinate of the system. We show 
that the arguments used in Sections [2] and [3] carry over to this more general 
case. 

4.1 Presentation of the model 

We consider a model with two particles. Each particle contains k spin- like 
variables, that can take the value (spin down) or 1 (spin up). At time t, the 
state of the system is given by Y\ = (X\, Z\) G M x M, where M = {0, l} fe 
is the space for the k spins of each particle. For each particle, we are given 
an energy functional £ (x) = £ (xi, . . . , x^) (with xj G {0, 1}, 1 < j < k) 
that depends on the state of the k spins of the particle. One choice is to 
set £ (x) = x\ + • • • + Xfc, which would correspond (up to a multiplicative 
factor) to the energy of k spins in a uniform magnetic field. 
The intensity matrix of the process Y is built as follows: 

• the internal dynamic of each particle is governed by an intensity matrix 
Q that conserves its energy, i.e. Q(x,x') = if £ (x) ^ £{x'). We 
define the global internal dynamic intensity matrix Q° by 



• the coupling between the two particles is described by a matrix C. This 
coupling introduces an exchange of energy between the two particles, 
while keeping the total energy constant. We assume that C is such 
that 



C ((x, z) , (x', z')) = if £ (x) + £{z)^£ (x') + £ (z') or if £ (x) = £ (x'). 



Q ((x,z) , (x',z)) 
Q {(x,z) ,(x,z')) 
Q°((x,z),(x',<)) 



Q (x, x') if x ^ x', 
Q(z, z) ifz^z', 
if x ^ x' and z ^ z' . 



• the transition intensities of the process Y e are given by 



Q e = Q + eC. 
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We make the following assumption: 

the matrix Q is such that, for every admissible energy level e, 

the state class of energy e is irreducible (39) 
and thus admits a unique invariant probability measure 7T 6 . 

We denote by 7r e the probability measure on M defined by ir e (x) = Jf e (x) if 
£ (x) = e and ir e (x) = otherwise. Any normalized linear combination of 
the measures ir e (with non-negative coefficients) is thus an invariant prob- 
ability measure of Q. We consider the state classes of M x M such that 
the energy of each particle stays constant. These classes are irreducible and 
admit a unique invariant probability measure ir e (g> tt £ . The invariant prob- 
ability measures of Q are of the form {Z')~ l Y^ e e > Z (e, e') 7r e 7r e ', where 
Z (e, e') > are some coefficients and where Z' is a normalization constant. 

4.2 Main result 

As pointed out above, our quantity of interest is £ (X t ), the energy of the 
first particle. In view of the chosen scaling in Q e , the characteristic time 
scale of evolution of this energy is of the order of e _1 . We thus need to 
rescale in time the evolution, and therefore introduce Y t e = (A t e , Z\) := Y t j e 

and £{ = £ (X e t/t ). 

We now identify the limit of the process £^, and state the main con- 
vergence result of that section, namely Theorem 14.11 below. Let L e be the 
generator of (Y t e )t>o, which is a jump process of intensity matrix Q e = e~ 1 Q . 
We have 

L e ip(x,z)= Q e {(x,z) ,{x',z')) [ip(x',z') - (p(x,z)}. 

x',z'eM 

For a function cp (x, z) = F (x) that only depends on the state of the first 
particle, we have 

(L*F)(x,z) = J2 Q £ {(x,z),{x',z')) [F(x')-F(x)] 

x',z'eM 

= e" 1 QM [F(x')-F(x)] 

x'GM 

+ Yl C((x,z),(x',z'))[F(x')-F(x)}. 

x',z'eM 
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Now choosing F = £, we obtain 

l(x,z):=(L*£)(x,z) = Yl C((x,z),(x',z')) [£(x')-£{x)\ 

x',z'eM 

since Q (x, x') = if £ (V) ^ £{x). We suppose that, at the initial time, the 
energy of each particle is independent of e: £(Xq) = E x and £ (Zq) = E z , 
where E x and E z are independent of e. The total initial energy is denoted 
E = E X + E Z . 

Using Proposition IA.ll we see that there exists a martingale Ml such 
that 



£t = E x + f l{XlZl)ds + Ml 
Jo 



(40) 



As in Section 12. 2\ we can show that there exists a process £ such that 
£ e converges to £, up to extraction. We now identify the distribution of 
the process £ and show that it is independent of the chosen sub-sequence 
(thereby proving that all the sequence £ e converges to £ , and not only a 
subsequence) . 

We introduce the average of the drift in (I40p with respect to an invariant 
measure of Q : 

Ke u e 2 ) = J2 l{x,z)it e ^{x)TT e *{z) 

x s.t. £(x) = e-^ 
z s.t. £(z) — e.<2 

Y, ^(x)^(z) Y C((x,z),(x',z')) [£(x')-£{x)\ 



x s.t. e(x)=e 1 x',z'eM 

z s.t. £{z) — e2 



* ei {x)^{z) C{(x,z),{x',z')) [£(x') 



x s.t. £(x) = ei x 1 ,z f s.t. 

z s.t. £(z) = e 2 £(x / )+£(z') = e 1 + e 



We further define 
and 

and recast (PiPl as 



f(x,z) = l(x,z)-l(£(x),£(z)) 

g(e)=T(e,E-e), (41) 



£1 = E x + f f (XI, ZD ds+ f g {ft) ds + Ml 
Jo Jo 



(42) 
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We now want to pass to the limit e — > in ()42p . 

Consider the second term in the right-hand side of (|42p . By construction, 
/ is the difference between the function I and its average I. The average of 
/ is thus expected to vanish. This is indeed the case: for any two energies 
ei and e 2 , we compute 



(7T ei ®7T e2 ) T / = VT ei (x)7T e2 (z)/(x,z) 

x s.t. f (a;) — 
z s.t. £ (2) — e2 

7r ei {x)Tr e ^z)l{x,z) - vr ei (x)7r e2 (z)r(ei,e 2 ) 

x s.t. £(x) = e-^ a; s.t. — e-^ 

2 s.t. £{z) — e2 2 s.t. f (2) — e2 

J2 K ei (x)ir e *(z)l(x,z) -I(ei,e 2 ) 

a: s.t. £ (^) — e l 
2 s.t. £(2) = e2 

= 0. 

Therefore, for any fi such that fi T L° = 0, we have = 0. Following the 
arguments of Proposition l2.8l we deduce that, for any t, the random variable 

/ / (X e s , Z e s ) ds converges to in L 2 (Q), and that the random process also 
Jo 

weakly converges to 0. 



We now turn to the third term of the right-hand side of (|42ft , and claim 
that (up to the extraction of a sub-sequence) 

f g(£ e s )ds => [ g(£ s )ds, (43) 
J J 

where £ s is such that £J £ s . The function g is defined on the set £ (M) 
of the admissible energies, which is a finite set (we recall that M = {0, l} fc ). 
We denote by g the PI interpolation of g on R, which is a piecewise linear 
function defined on R and that coincides with g on £ (M) . The function g 
being Lipschitz on R, we infer from Lemma 12.61 that the function 



{^J g{x s )ds^ 
that 



is continuous. Therefore, the convergence £ e s £ s implies 

t 



g(£ e s )^j = (J g{£ e s ) \ converges to (J g(£ s )^j = (J g{£ s 
We thus have proved (f4~3|) . 
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We next turn to the last term in the right-hand side of (|42p. As in the 
previous sections, we can show that M e weakly converges (up to extraction) 
to some martingale M. 

We can now pass to the limit e — > in (|42p . and obtain that the limit 
process £ satisfies 



£t = E x + [ g {£,) ds + M t 
Jo 



(44) 



It is now easy to recast the above equation in a more useful form. In view 
of (HU, we indeed note that 

9 



( e ) = E E E ^(x)7r E - e (z)C((x,z),(x',z'))(e'-e) 



e ' X s.t. £{x)=e x l s .t. £(x')=e' 



B E (e,e') 

Therefore, the equation (|44p reads 

St = E x + fy^BE (£„ e') (e' - S s ) ds + M t , 
Jo e , 

where, we recall, E is the total energy of the system, which is preserved 
along the dynamics. 

We conclude this formal approach by pointing out that the above equa- 
tion actually does not allow to identify the law of the process (£t)t- I n the 
proof of Theorem 12.31 (see Section I2.2j) , we performed that step of the proof 
by using Lemma 12.51 which is not possible in our context here. To identify 
the law of the process (£t)t, we resort to Lemma lA. 21 Consider a bounded 
function <p on £ (M) , and the martingale 

Mt e := p (£t) ~ V (E x ) - f Y, B E {£1 e') (<p (e') - <p (£!)) ds. 

Jo e , 

Following the same steps as above, we show that each term converges when e 
goes to zero. In particular, Mf ,£ converges to a martingale M v that satisfies 



M? = <p 



(St) - V (E x ) - r V B E (£ s , e') (<p (e') - (p (£,)) ds. 
Jo Z 



Lemma IA.2I then implies that £ is a jump process of intensity matrix B 
B E (e,e'). 

We thus have the following result: 
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Theorem 4.1. We denote by V e the distribution of the process {£ e ), where 
we assumed that the initial condition (E X ,E Z ) is independent of e. We de- 
note by V the distribution of the jump process of initial condition E x and of 
intensity matrix B = Be (e, e'), with E = E x + E z . Under the assumptions 
on the matrices Q and C described in Section \4-l\ we have 

-p e =>-p as e 0. 
4.3 Numerical illustration 

We have numerically simulated the system described above, when each par- 
ticle has two spins, i.e. k = 2. In this case, Card(M) = 4, and the admissible 
states for each particle are labelled as 1: 44,, 2: tlj 3: 4-T an d 4: ff. The 
energy of each particle is the sum of the energies of its two spins, which are 
equal to (spin down, |) or 1 (spin up, T)- The matrix Q that governs the 
internal dynamic of each particle is of the form 

\ 
91 
-q 2 ' 
/ 

This matrix preserves the energy of the particle as it only allows transitions 
between states of the same energy (namely, T4- an( A It)- We work with 
qi = 10 and q 2 = 1. 

There are five possible initial energies for the complete system: 

• E = (both particles are initially in the state 1: 4-4-)- The system then 
does not evolve, as only one state corresponds to that total energy. The 
case when E = 4 is similar. 

• E = 1: initially, one particle is in the state 1: 4-4-) while the other 
particle is in the state 2: tl or 3: 4-T- We consider this case below. 
Note that the case when E = 3 is similar. 

• E = 2: without loss of generality, we may assume that the initial state 
of each particle is 2: T4-- 

In what follows, we only consider the case E = 1. We have checked that 
results obtained in the case E = 2 lead to the same qualitative conclusions. 

As mentioned above, we assume that the initial state of the first particle 
is 2: |4- (corresponding to the energy E x = 1), and that the initial state of 
the second particle is 1: 4-4- (corresponding to the energy E z = 0). 



Q 



( 

-qi 

q 2 

\ 
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The matrix C (which encodes how the two particles interact) is chosen 
of the form 



C{(2,z),{x',z')) 
C((x,z),(x',z')) 
C((x,z),{x',z')) 



ci if £{x) + £(z) = £ (x') + £ (z') and £{x) + £ (a/), 

c 2 if x ^ 2 and £{x) + £{z) = £ (x') + £ (z 1 ) and £{x) ^ £ (x'), 

otherwise. 



We work with c\ = 1 and c 2 = 0.2. 

We monitor the distribution of Sq, the first waiting time before an ex- 
change of energy between the two particles occurs. Figures [T5l and [TBI show 
the convergence of the distribution of Sq to the asymptotic distribution, 
which is an exponential distribution of parameter B (1,0) = 6/11. 



-r * i~ 



Figure 15: Empirical expectation (left) and variance (right) of Sq as a func- 
tion of e. 




Figure 16: Left: Distribution of the first waiting time Sq before the energy 
of the first particle changes (e = 10~ 3 ); Right: L 1 error (|30p between the 
distribution of Sq and its limit distribution. 



40 



Acknowledgments 

The models we consider here and the questions we study were suggested to 
us by Stefano 011a. We thank him for his suggestions and the fruitful discus- 
sions we had with him. We also thank Eric Cances for his constant support 
throughout this research project. We thank Tony Lelievre for his careful 
reading of a previous version of this article. The research leading to these 
results has received funding from the European Research Council under the 
European Community's Seventh Framework Programme (FP7/2007-2013 
Grant Agreement MNIQS no. 258023). 

A Some useful results 

For convenience, we recall in this Appendix some classical results of proba- 
bility theory that are needed in this article. 

Martingales Several results on martingales are useful in this work. The 
first one is an existence and uniqueness result for the martingale problem 
introduced by D.W. Stroock and S.R.S. Varadhan (see e.g. pQ and [19]): 

Proposition A.l (Lemma 5.1 of Appendix 1 of [9]). Let (Xt) t>0 be a 
Markov process and let (J~t) t>0 be its natural filtration. For any bounded 
function F, we introduce 

M F = F (X t ) - F (X ) - f LF (X s ) ds 

Jo 

and 

Nf = (Mf) - / (LF 2 (X s ) - 2F (X 8 ) LF (X s )) ds, 
Jo 

where L is the generator of the Markov process (Xt). Then M F and N F are 
Ft-martingales. Ln particular, the quadratic variation of M F reads 

(M F ) t = [ (LF 2 (Xs)-2F(Xs)LF(X s ))ds. 
Jo 

We recall that for a continuous local martingale M, the process (M) is 
defined to be the unique right-continuous and increasing predictable process 
starting at zero such that M 2 — (M) is a local martingale. 

The next result is of paramount importance to prove that a process is a 
jump process, and to identify its generator. We state here this result as a 
simplified version of [HJ Theorem 21.11]. 
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Lemma A. 2 (Uniqueness result for the martingale problem). Let F be a 

countable space, Zf a stochastic process valued in F and L an operator on 
bounded functions ip : F — > R defined by 

Ltp(x) = ^2 L z,x' {<f{d) - , 
x'eF 

where L xx i > for any x,x' £ F and sup x x , eF L x x ' < oo. If for any 
bounded function ip : F — > R, i/ie process 

Mf := 99 (Z t ) - 99 (Z ) - I Lip (Z s ) ds 

J o 

zs a martingale w.r.t. the natural filtration of (Zt)t>o, then (Zf)t>o is the 
jump process of initial condition Zq and of generator L. 

Convergence of probability measures We now turn to classical results 
concerning the convergence of probability measures in Dr [0, oo), which is 
the space of functions that are right continuous with left limits (the so-called 
cad-lag functions), defined on [0, oo) and valued in R. Proposition IA.3I gives 
an equivalent definition of the Skorohod metric on £>r [0, oo) (see [U p. 116- 
118] for the original definition of the Skorohod metric, that we actually do 
not use in this work). Theorem I A.4I states convergence criteria for probabil- 
ity measures on Dr [0, oo). 

Proposition A. 3 (Proposition 5.3, Chap. 3 of [4]). Let (x n ) n >o be a se- 
quence in .D]r [0, oo) and x £ -Dr [0, oo). The following assertions are equiv- 
alent: 

• lim x n = x in the space -Dr [0, oo) endowed with the Skorohod metric. 

n— >oo 

• For any T > 0, there exists a sequence of strictly increasing, continu- 
ous maps (A n ) n >o defined on [0, oo) and valued in [0, oo) such that 

lim sup | A n (t) -t\ = (45) 

n ^°°o<t<T 

and 

lim sup \x n (t) - x (A n (t)) | = 0. (46) 
n-Kx> <t<T 

Theorem A. 4 (Aldous' criterion, Theorem VI. 4. 5 of [7]). Let (X n ) n >i be 
a sequence of cad-lag processes, with distributions V n . Suppose that 
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• for any N € N and e > 0, there exists uq € N, no > 0, and K £ M + 
such that, for any n > hq, 

V n ( sup|X f "| > K] < e. (47) 
\t<N J 

• for any N £ N and a > 0, we have 

lim limsup sup V n (\X% - X%\ > a) = 0, (48) 

8^0 n 5,TeX™ , 5<T<5+6» 

where T^r is t/ie sei of all T n stopping times that are bounded by N. 
Then the sequence (X n ) n£ ^ is tight. 
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